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I.  INTRODUCTION 
A.  Background 

During  the  period  of  September  1979  through  September  1980,  Pha^e  1  of 
the  experimental  study,  "Interactive  Digital  Image  Processing  for 
Terrain  Data  Extraction",  was  performed.  The  12-month  study  Investigated 
the  feasibility  and  utility  of  man-machine  Interactive  digital  processing 
techniques  when  applied  to  the  extraction  of  terrain  analysis  data  from 
aerial  Imagery.  The  study  focused  primarily  on  the  extraction  of  vege¬ 
tation  data  elements  from  digitized  panchromatic  photography,  with  a 
small  amount  of  attention  given  to  thermal  Infrared  and  side-looking 
radar  Imagery. 

Of  thirteen  vegetation  data  elements  listed  In  the  USAETL  Terrain  Analysis 
Procedural  Guide  for  Vegetation,  eight  were  addressed  in  varying 
degrees  of  depth.  Interactive  digital  techniques  were  developed  for 
vegetation/land  cover  boundary  extraction  and  for  the  extraction  of 
several  forest -related  data  elements.  For  the  forest-related  elements, 
three  digital  themes  were  developed  from  digitized  panchromatic 
photography.  The  three  digital  themes  and  a  developed  automatic  operation 
allowed  estimates  of  percent  canopy  closure,  stems  per  hectare;  crown 
diameter;  stem  diameter;  stems  per  hectare  per  diameter  class;  and  stem 
spacing  to  be  produced.  Best  results  were  achieved  with  a  spatial 
resolution  of  approximately  three  feet  In  the  Input  digital  image. 

In  addition,  techniques  were  developed  enabling  the  extraction  of  vege¬ 
tation/land  cover  boundaries.  These  techniques  were  most  effective 
when  the  spatial  resolution  of  the  digital  Image  Is  In  the  range  of 
8  to  20  feet.  With  a  moderate  amount  of  Interactive  analysis,  processing 
can  be  employed  to  extend  the  boundary  extraction  rapidly  and  efficiently 
to  relatively  large  areas.  Procedures  were  also  developed  for  distance, 
elevation,  and  area  measurement  from  digital  Imagery.  Further  testing  and 
development  of  new  technqiues  were  recommended  as  a  result  oF  Phase  1 
work. 
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B.  Objective 

The  objective  of  the  Investigation  was  to  continue  the  study  of  inan>inach1ne 
digital  Image  processing  techniques  to  the  extraction  of  terrain  analysis 
data  from  aerial  Imagery. 

C.  Scope 

The  scope  of  the  second  phase  part  of  the  study  Involved  the  extraction 
of  data  Identified  In  the  Terrain  Analysis  Procedural  Guide  for  Drainage 
and  Hater  Resources.  Within  the  scope  was  the  development  and  coding 
of  software  and  algorithms  for  filtering  themes  and  Image  scaling.  Input 
data  for  the  second  phase  Included  panchromatic,  thermal  Infrared  and  side 
looking  synthetic  aperature  radar  Imagery. 

D.  Water  Resources  Elements 

In  this  second  phase,  the  water  resources  elements  considered  were: 

1.  Alignment  of  watercourses 

2.  Shore  alignment  of  waterbodies 

3.  Delineation  of  wet  areas 

4.  Identification  of  areas  subject  to  flooding 

5.  •  Identification  of  terminal  points  of  watercourse  segments 

6.  Measurement  of  bank  heights 
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II.  IMAGERY  USED 

A.  Data  Selection 

Data  types  used  for  Phase  2  consisted  of  two  forms,  I.e.  dIgItaY. 
and  Imagery.  Imagery  selected  as  transparencies  were  digitized  Into 
512  X  512  pixel  Images  (subscenes)  with  8-b1t  gray  level  quantization. 
Certain  data  sets  used  In  phase  1  were  applied  In  Phase  2,  specifically 
pertaining  to  Fort  BelvOlr/UoodrIdge,  Va.  area  and  Daedalus  scanner 
Images  of  Pennsylvania.  Additional  panchromatic  photography,  synthetic 
aperture  radar  (SAR),  thermal  Infrared  (TIR)  and  Infrared  (IR)  data  were 
acquired  from  the  Tennessee  Valley  Authority  (purchased)  and  General 
Electric  Space  Division  (loaned)  at  Valley  Forge.  Selection  of  data 
used  for  analysis  considered  the  following  factors: 

e  Scene  content  (various  watercourses  and  water  bodies) 

e  Resolution  (watercourses  of  1-15  meters  width) 

e  Absence  of  clouds,  cloud  shadows  and  haze 

e  Uniformity  of  scene  feature  brightness  levels  across  the  Image 

e  Near-vertical  view  of  the  scene 

#  General  quality  of  the  transparency  (I.e.  absence  of  scratches,  etc) 

B.  Data  Sets 

A  list  of  all  data  sets  used  for  the  generation  of  selective  512  x  512 
pixels  Images  (subscenes)  Is  shown  In  Table  1. 

Table  1 

1.  Elizabeth  City,  North  Carolina;  Imagery;  USAETL 
a.  Knobbs  Creek  Area 

(1)  98°  synthetic  aperture  radar  #1  Imagery 

(2)  52°  synthetic  aperture  radar  #9  Imagery 

(3)  Panchromatic  139  Imagery 

(4)  High  resolution  thermal  fllghtllnes  2,  3  and  4 
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Table  1  (Cont.) 


b.  Little  River  Area 

(1)  98®  synthetic  aperture  radar  #5  Imagery 

(2)  98®  synthetic  aperture  radar  #9  Imagery 

(3)  52®  synthetic  aperture  radar  #5  Imagery  , 

(A)  52®  synthetic  aperture  radar  #10  Imagery 

(5)  278®  synthetic  aperture  radar  #5  Imagery 

(6)  High  resolution  thermal  Infrared  #9  Imagery 

(7)  Low  resolution  thermal  Infrared  Imagery 

c.  New  Begun  Creek  Area 

(1)  98®  synthetic  aperature  radar  #10  Imagery 

(2)  278®  synthetic  aperature  radar  #6  Imagery 

(3)  Panchromatic  #95  Imagery 

(4)  Low  resolution  thermal  Infrared  Imagery 

d.  Chapel  Creek  Area 

(1)  278®  synthetic  aperature  radar  #14  Imagery 

(2)  Panchromatic  #91  Imagery 

(3)  Panchromatic  #120  Imagery 

e.  Symond  Creek  Area 

(1)  Panchromatic  #47  Imagery 

(2)  High  resolution  thermal  Infrared  Imagery 

2.  Ripley,  West  Virginia  Area,  digital.  General  Electric  Company 

a.  X'band  horizontal  polarization 

b.  X-band  vertical  polarization 

c.  L-band  horizontal  polarization 

d.  L-band  vertical  polarization 

3.  Clarion  County,  Pa,  digital,  from  Phase  1  study 

a.  20,000  ft.  altitude;  green  and  thermal  Infrared  channels 

b.  10,000  ft.  altitude;  green  and  thermal  Infrared  channels 

c.  5,000  ft.  altitude;  green  and  thermal  Infrared  channels 
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Table  1  (Cent.) 


4.  Fort  Belvoir/Woodbridge,  Va.  Area,  Imagery,  USAETL,  from  Phaae  l.study 

a.  Panchromatic  photographs 

5.  Tennessee  Valley  Authority 

a.  Holston  River  set 

e  Thermal  Infrared  (TIR)  low  resolution  (flight  line) 
e  Five  panchromatic  photographs  of  flight  line  area 

b.  Night  TIR  (low  air  temperature) 
e  Six  panchromatic  photographs 

c.  Reservoir 
e  TIR 

Five  panchromatic  photographs 
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III.  TECHNIQUES  DEVELOPMENT 

A.  Image  Resolution  and  Scale  Changing 

As  reported  In  the  first  phase  of  this  project,  spatial  operators. 

Mhich  Include  the  reported  microtexture  and  crown  template  operators, 
are  very  useful  tools  for  the  Interpretation  of  monochromatic  Imagery. 

The  program  of  successfully  categorizing  monochrome  Imagery  Is  l^n  general 
a  much  more  difficult  program  than  with  other  types,  such  as  multi spectral, 
because  of  the  relatively  smaller  amount  of  Information  available. 
Attempting  to  categorize  an  Image  by  level  slicing  alone  encounters  serious 
problems,  the  most  difficult  being  that  signatures  tend  not  to  be  unique 
enough  to  be  used  as  the  sole  descriptor  of  the  classes  generally  desired. 
Even  seemingly  simple  classes  like  water  bodies  can  be  Impossible  to 
extract  via  level  slicing.  Clearly  more  Information  than  gray  level 
Is  required  to  perform  categorization,  and  clearly  such  Information  Is 
available.  In  the  form  of  spatial  patterns. 

In  particular,  textural  Information  Is  of  considerable  value  In  the 
analysis  of  high  resolution  Images.  Texture  Is  an  encompassing  term  with 
a  multitude  of  types  and  definitions,  most  of  which  have  limited  use  In 
remote  sensing.  The  most  basic  and  perhaps  most  widely  applicable  type 
of  texture  Is  simply  surface  roughness,  which  can  be  relatively  easily 
determined  by  computing  local  Image  variance.  Textural  operations  are 
scale  dependent  and  for  effective  use,  must  be  applied  at  a  specific 
scale  which  is  defined  by  the  size  of  the  microfeatures  which  generate 
the  rough  appearance  of  larger  features  being  extracted.  For  example, 
a  typical  Image  might  contain  three  features  which  we  wish  to  separate, 
pasture,  brush  land,  and  forest.  Each  of  the  features  Is  basically 
a  random  mixture  of  vegetation  and  shadow,  and  quite  likely  all  three 
exhibit  approximately  the  same  Integrated  reflectance.  Each  of  the 
features  also  exhibit  similar  textural  structure,  the  appearance  of  random 
roughness,  but  they  are  distinctly  different  In  textural  scale. 

To  realize  the  full  potential  of  scale  dependent  spatial  techniques 
we  must  be  able  to  efficiently  vary  the  size  of  the  spatial  operators 
used  (or  at  least  the  effective  size),  allowing  the  extraction  of  a 
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considerable  range  of  spatial  features.  This  scaling  can  be  accomplished 
by  either  of  two  methods:  (1)  by  scaling  the  operator  Itself,  which  Is 
the  historic  method,  or (2)  by  changing  the  scale  and  resolution  of  the  Image 
and  applying  a  universal  operator.  The  Image  scaling  approach  appears 
to  have  several  significant  advantages: 

•  Scaling  of  all  but  the  simplest  of  spatial  operators  Is 
not  as  straight  forward  as  Is  reducing  resolution  and 
scaling  an  Image.  Any  resolution  up  to  that  Inherent 
In  the  original  data  can  easily  be  simulated  with  very 
simple  and  rapidly  executed  algorithms.  Allowing,  for 
example,  the  highly  effective  and  reasonably  sized 

max -min  microtexture  operator  to  be  used  without 
modification.  In  the  extraction  of  a  wide  variety  of 
textural  Identifiable  features. 

•  Matching  spatial  feature  templates  to  objects  of  a 
particular  size  can  be  done  much  more  precisely  by 
changing  Image  scale,  as  finer  scaling  Increments  can 
be  used.  Many  effective  spatial  operators  cover  areas 
as  small  as  3  x  3  pixels,  thus  the  finest  scale  adjust¬ 
ment  would  be  a  factor  of  1/3. 

•  The  reduction  In  the  computation  time  required  to  apply 

an  equivalent  operation  Is  significant  when  Image  scaling 

Is  chosen.  Reduction  In  resolution  means  reductions  In 

the  volume  of  data  processed.  Reducing  Image  size  by  a 

factor  S  reduces  the  number  of  pixels  to  be  considered 
2 

by  S  ,  compared  with  Increasing  the  operator  size,  which 

2 

would  Increase  most  spatial  computations  by  S  .  The  relative 
difference  approaches  S^. 

During  Phase  1  of  this  study.  Image  scaling  was  accomplished  by  utilizing 
those  techniques  which  were  readily  available  at  General  Electric  DIAL 
without  software  development.  While  the  usefulness  of  Image  scaling  to 
expand  the  utility  of  standard  and  simple  spatial  operators  was  firmly 
established,  the  actual  methods  were  cumbersome  and  time  consuming. 
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The  ability  to  vary  Image  scale  and  resolution  rapidly  enough  for  use  In 
Interactive  analysis  was  quickly  Identified  as  being  a  missing  and 
necessary  tool . 

Given  the  task  of  using  spatial  Information  as  an  Input  for  the  categoriza¬ 
tion  of  some  Image  feature,  a  fairly  lengthy  procedure  might  be -followed. 
First  the  Image  would  be  reduced  In  scale  and  resolution  by  some  factor 
defined  by  the  predominant  spatial  frequency  of  the  object  to  be  extracted. 
For  example,  the  mean  distance  between  shadows  In  forest  canopy.  A 
spatial  operator  Is  then  applied  to  the  reduced  Image  generating  a  derived 
Image  where  the  spatial  feature  has  been  extracted  or  enhanced.  This 
secondary  Image  Is  then  enlarged  to  the  scale  of  the  original  for  subsequent 
analysis.  Since  the  derived  Image  contains  Information  of  a  nature 
Independent  from  the  spatial  grey  level  information  of  the  original, 

this  operation  essentially  creates  a  multidimensional  feature  space 
which  significantly  Increases  an  analyst's  options  when  attempting  to 
categorize  a  monochrome  Image.  Repeating  the  operation  at  several  scales 
generates  an  even  more  Interesting  feature  space  of  higher  dimensionality. 

Based  on  the  experience  gained  during  the  Phase  1  analysis  of  several 
Images,  a  program  was  written  to  perform  Image  scaling  by  any  of  three 
operator  selected  interpolation  methods,  nearest  neighbor,  area  averaging, 
and  a  fairly  unique  subpixel  Interpolation  method  based  on  local  scene 
context.  Figure  1  Is  a  flow  chart  of  the  program. 

1.  Scale  Changing  via  Pixel  Replication 

Often  simple  replication  of  pixels  Is  a  satisfactory  or  even  desirable 
method  of  changing  the  scale  of  an  Image.  Whether  or  not  It  should  be 
the  chosen  method  Is  dependent  on  the  specific  Image  processing  task 
being  performed.  For  example.  If  one  desires  to  quickly  examine  an 
'overview'  of  a  large  Image  containing  too  much  data  for  complete 
display  on  a  CRT,  Interpolative  resampling  with  Its  associated  computation 
could  be  a  waste  of  time.  In  other  cases,  such  as  resampling  an  Image 
with  a  very  small  scale  change,  no  noticable  degradation  will  be  suffered 
with  this  technique.  Finally,  there  are  many  applications  where  original 
radiometric  values  must  be  preserved.  In  these  cases  replication  or 
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Figure  1.  Image  Scaling  Program  Flow  Diagram 
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nearest  neighbor  resampling  Is  the  only  simple  method.  Examples  are, 
when  sensor  characteristics  are  being  extracted,  or  when  thematic  or 
binary  Images,  which  are  not  gray  scale  In  nature  must  be  icaled. 

Pixel  replication  sounds  like  a  trivial  problem,  but  the  capability 
Is  so  basic  and  heavily  used  In  Image  processing,  that  a  serlou^s  look 
at  Implementation  and  execution  time  Is  worthwhile.  In  several  recent 
Image  processing  systems  the  Implementation  Is  via  hardware  and  operations 
are  performed  In  near  time.  For  other  systems,  a  software  solution  Is 
very  reasonable,  as  rapid  execution  can  be  achieved. 

Since  no  real  pixel  by  pixel  computation  Is  required,  either  In 
determination  of  output  pixel  value,  or  In  determination  of  output 
position,  algorithms  can  be  used  which  amount  only  to  moving  data  In  a 
high  speed  manner  from  a  predetermined  location  to  a  predetermined 
destination.  This  Is  accomplished  by  setting  up  two  address  tables 
based  on  the  replication  or  sampling  required  along  lines  and  between 
lines.  These  tables,  one  with  an  element  for  each  output  line  and  one 
with  an  element  for  each  output  pixel,  contain  addresses  In  the  Input 
Image.  Each  of  these  addresses  Is  then  the  source  location  for  each 
desired  output  pixel . 

Using  these  tables,  the  actual  execution  Is  performed  by  indirect 
addressing.  Data  movement  can  be  done  by  several  methods  Including 
special  purpose  hardware  and  replacement  statements  from  a  high  level 
programnlng  language.  In  this  case  replacement  was  done  In  an  assembler 
routine  to  minimize  execution  time.  Omitting  I/O  limitations,  the  program 
takes  approximately  three  seconds  to  construct  a  512  x  512  pixel 
output  Image.  Figure  2  shows  the  algorithm  used. 

2.  Fast  Area  Averaging 

This  capability  Is  fundamental  for  the  extraction  of  scaled  spatial 
information  from  high  resolution  Images  In  the  manner  described  In  Phase  1. 
Starting  with  an  Image  digitized  and  stored  at  the  highest  desired 
resolution  area  averaging  Is  used  to  generate  a  secondary  Image  of 
"super  pixels”  where  digital  numbers  are  related  to  the  Integrated 
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Figure  2.  Scale  Change  by  Replication 


reflectance  from  a  large  number  of  original  pixels.  The  spatial  frequency 
content  of  the  derived  Image  Is  cut  off  by  the  span  of  the  averaging  area, 
simulating  an  Image  that  might  result  If  the  same  sensor  and  objects 

were  used  In  a  lower  resolution  (higher  sensor  altitude)  configuration. 

/ 

In  use,  as  the  averaging  area  Increases,  the  observable  texture  of  finely 
structured  areas  di-sap  pears  from  the  derived  Image.  Textural  Information 
can  then  be  extracted  by  differencing  the  derived  Image  with  the  original 
in  a  manner  similar  to  a  technique  widely  used  for  edge  extraction. 

Area  averaging  Is  then  applied  to  the  derived  difference  Image  as  a 
smoothing  function  which  generates  a  grey  level  Image  where  the  digital 
number  Is  proportional  to  the  local  high  frequency  content  (texture)  cut 
off  by  the  original  application  of  the  filter. 

The  approach  chosen  to  Implement  the  filter  was  to  use  an  adaption  of 
the  highly  efficient  box  filtering  technique.  Box  filtering  computes  a 
moving  average  over  a  rectangular  area  by  using  two  linear  moving  averages, 
one  down  Image  columns  and  one  along  Image  rows.  Execution  Is  very 
efficient.  If  the  box  size  Is  small  In  relation  to  the  Image  size, 
the  number  of  operations  required  to  compute  one  output  pixel  approaches 
four,  and  Is  Independent  of  box  size.  While  box  filtering  computes 
more  output  pixels  than  are  needed  for  scale  changing.  It  Is  unlikely 
that  any  other  algorithm  can  approach  this  efficiency.  The  scale  changing 
program  computes  all  of  the  column  averages  used  In  box  filtering, 
but  computes  row  averages  only  for  the  required  output  lines.  Required 
output  pixels  are  stripped  from  the  row  average  at  regular  Intervals. 

All  along  row  operations  are  done  In  assembler  subroutines  to  minimize 
execution  time. 

As  with  all  spatial  operations,  some  trickery  must  be  used  to  avoid 
undesirable  Image  border  effects  without  reducing  the  size  of  the  output 
Image.  Since,  for  our  application,  the  derived  Images  are  often  to  be 
recombined  with  their  fu11  resolution  parents,  maintaining  Image  size  Is 
very  Important.  This  need  Is  particularly  acute  If  large  filters  are 
used.  Data  must.  In  effect,  be  manufactured  so  that  the  moving  averages 


do  not  contain  pixel  values  of  zero  at  Image  edges.  The  method  chosen 
as  being  the  least  objectionable,  mbs  to  Increase  Input  Image  size  by 
reflecting  data  values  about  Image  borders.  Figure  3  shows  the  algorithm 
for  fast  area  averaging. 

/ 

3.  Sub-pixel  Interpolation  for  Image  Enlargement 
Selection  of  an  Interpolation  algorithm  for  use  In  Image  enlargement 
Is  not  quite  as  straight  forward  as  many  recent  papers  on  the  subject 
would  lead  us  to  believe.  Truncated  or  otherwise  modified  versions  of 
the  "theoretically  perfect"  (sine x)  Interpolation  have  been  used  to 
achieve  good  Interpolation  with  a  minimum  of  computation.  However,  some 
Interesting  artifact  producing  properties  are  made  evident  when  we  use 
these  Interpolators  an  an  enlarging  tool.  In  fact,  making  an  enlarge¬ 
ment  Is  an  excellent  means  of  graphically  showing  many  of  the  problems 
associated  with  various  algorithms. 

'he  often  used  and  much  discussed  "cubic  convolution,"  for  example, 
which  computed  an  Interpolated  value  based  on  16  surrounding  pixels 
produces  a  curious  effect  on  edges  with  certain  orientations.  When 
the  point  to  be  Interpolated  falls  directly  on  one  of  the  lines  defined 
by  the  pixel  grid  of  the  original  Image,  this  algorithm  performs  admirably. 
In  these  cases,  the  algorithm  degenerates  to  a  one-dimensional  operation. 
When  the  Interpolation  falls  between  the  lines,  two-dimensional  Inter¬ 
polation  Is  performed  and  considerable  aliasing  can  occur.  When  the 
original  Image  contains  an  edge  feature  oriented  at  45^  to  the  pixel  grid, 
the  aliasing  Is  most  apparent.  The  optimum  (sine x)  Interpolation  would 
produce  a  blurred  (from  enlargement)  but  straight  edge  In  the  output  image. 
The  cubic  convolution  reproduces  the  45°  edge  with  a  wobbly  sine  wave 
appearance,  showing  that  Individual  Interpolated  values  are  as  much  a 
function  of  resampling  position  as  they  are  of  Image  content. 

The  other  commonly  discussed  Interpolator,  bilinear  Interpolation,  has 
been  shown  In  numerous  studies  to  perform  Just  a  little  worse  than  cubic 
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Figure  3.  Fast  Area  Averaging 
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convolution  In  Just  about  every  respect.  True  to  form,  when  subjected 
to  a  visual  "enlargement  test"  It  shows  45^  artifacting  a  little  more 
severe  than  cubic  convolution  does.  Considering  that  It  only  requires 
fbur  points,  the  algorithm  does  not  perform  all  that  poorly.  Bilinear 
Interpolation  basically  performs  linear  Interpolation  along  two^:oppos1te 
sides  of  a  quadralateral  defined  by  four  pixels,  and  then  performs  a  third 
Interpolation  between  these  two  new  points.  It  then.  Is  based  on  the 
assumption  that  a11  four  points  lie  In  the  same  plane,  a  gross  assumption 
which  Is  Incorrect  whenever  the  four  points  are  over  an  Image  edge. 

The  Interpolation  scheme  chosen  was  a  four  point  Interpolation  which 
breaks  the  quadrilateral  defined  by  the  four  surrounding  points  Into 
triangles.  The  most  appropriate  traingle  for  Interpolation  Is  chosen 
by  the  direction  of  the  local  Image  gradient  and  by  the  position  of  the 
desired  point.  The  Interpolation  Is  then  controlled  by  Image  content 
and  handles  45°  edge  situations  well.  See  Figure  4. 

The  context  dependent  Interpolation  has  been  coded  and  tested  at  6E  DIAL 
and  performs  as  was  expected.  The  45°  artifacts  are  completely  eliminated. 
The  Interpolator  does  have  some  remaining  problems  which  could  ultimately 
show  up  In  factor  analysis.  Angular  artifacts  remain  at  22^5°  to  the 
pixel  grid  and  Isolated  points  are  reproduced  as  diamond  shapes.  Further 
use  In  the  generation  of  factor  overlays  should  determine  the  value 
of  this  method.  It  Is  likely  that  some  combination  of  a  linear  Interpolators 
and  a  context  dependent  Interpolator  would  produce  better  results. 
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FOUR  POINT  CONTEXT  DEPENDENT  INTERPOLPTION 


STARTING  WITH  INTENSITY  VALUES  SURROHDING  T>C  DESIRED 

POINT  LOCATION,  SELEa  FHON  T>C  FOUR  DEFITCD  TRIANGLES,  TTC  OTC 
INCLUDING  BOTH  T>C  POINT  LOCATION  AND  TTC  DIAGONAL  WITH  TVE 
SMALLEST  INTENSITY  GRADIENT.  LINEAR  INTERPOLATION  IS  DOTE  ON 
T»E  PLATE  DETERMirO  BY  T>E  SELECTED  TRIANGLE. 


CASE  «1  IF  ((fC-B|»IA-DI)  .AND.  (Y^X)) 
P-AfX(D-C)+Y(C-A) 

CASE  «2  IF  ((IC-BI»iA-DI  )  .AND.  (Y<X)) 
P-A*X(B-A)+Y(I>-B) 


CASE  «3  IF  ((lC-B|<(A-»)  .AND.  (X£(l-Y))) 
P-AtX(B-A)+Y(C-A) 

CASE  #4  IF  ((fC-BI<IA-Di)  .AND.  (XXl-Y))) 
P-C-X(D-C)-K1-Y)(B-D) 


Figure  4 
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B.  Feature  Skeletonizing 

At  the  end  of  Phase  1,  another  capability  seen  as  very  useful  for  the 
extraction  of  several  terrain  elements  was  the  ability  to  transform 
those  elements  characterized  by  filament  type  objects  Into  single 
pixel  width  lines.  Two  obvious  examples  of  elements  requiring ^the 
operation  are  the  delineation  of  watercourses  and  roads.  There, 
are  really  two  different  levels  to  the  program.  The  first  case,  where 
the  feature  Is  spatially  connected  I.e.  no  breaks.  Is  relatively 
easy  to  handle  by  using  a  line  stripping  algorithm  to  reduce  feature 
width  to  the  point  where  only  one  strip  of  adjacent  pixels  remain, 
bisecting  the  original  feature.  In  general,  however,  themes  are  not 
always  well  connected.  As  the  desired  feature  nears  the  resolution 
limit  of  the  Imagery,  or  Is  hard  to  categorize  for  some  other  reason, 
the  feature  Is  usually  mapped  as  a  tenuous  string  of  pixels  spaced 
with  many  gaps.  Any  widely  applicable  skeletonizing  algorithm  should 
be  able  to  bridge  at  least  small  gaps  and  then  shrink  the  feature  to 
produce  the  single  pixel  width  map. 

The  problems  are  demonstrated  vividly  when  one  attempts  to  extract 
watercourse  alignment.  As  described  In  the  element  extraction  section 
of  this  report,  several  methods  of  extracting  large  watercourses  are 
feasible  and  success  was  achieved  with  most  of  the  Images  Investigated. 
The  most  widely  applicable  methods  rely  on  Image  Intensity  slicing  In 
combination  with  the  unique  smoothness  or  lack  of  texture  that  water 
bodies  exhibit  to  most  sensors.  Extracting  the  alignment  of  very  narrow 
watercourses  Is  a  different  problem  as  there  Is  not  enough  resolution 
available  to  make  use  of  texture  or  any  other  positively  Identifying 
features.  While  the  watercourses  can  be  roughly  Identified  by  density 
slicing.  It  Is  difficult  to  classify  them  as  contiguous  objects.  Thin 
or  Intermittent  watercourses  are  often  revealed  to  the  photo  Inter¬ 
preter,  not  by  the  presence  of  clearly  Identifiable  water,  but  only  by 
subtle  changes  In  the  surrounding  vegetation,  or  as  a  linear  shadow 
with  no  water  being  Imaged. 
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Prior  to  a  skeletonizing  operation,  connectivity  of  the  feature  must 
be  established  If  we  are  to  work  successfully  with  narrow  watercourses 
and  roads.  Some  encouraging  results  In  this  area  were  obtained  by 
performing  a  very  low  pass  filtering  operation  (box  filtering),  on 
unconnected  binary  theme  maps.  Filtering  In  this  manner  generates  a 
slowly  varying  grey  level  output  where  losses  In  connectivity  hpve  been 
"bridged"  by  the  slowly  varying  Intensity  ramps.  The  operation  transforms 
strings  of  Isolated  pixels  Into  a  series  of  peaks  and  cols.  Level 
slicing  on  the  smoothed  Image  results  In  a  map  much  wider  than  the 
original  feature,  and  one  where  connectivity  has  been  established  across 
gaps  of  width  up  to  the  size  of  the  filter.  The  method  has  two 
undesirable  effects.  First  the  width  of  the  feature  Is  Increased  by 
up  to  twice  the  span  of  the  filter  size,  making  subsequent  skeletonizing 
by  line  stripping  methods  a  more  lengthy  process.  Second,  the  filtering 
Introduces  a  straightening  of  the  feature  centerline.  The  straightening 
can  become  pronounced  and  objectionable  when  filter  size  approaches  the 
dimensions  of  feature  characteristics  such  as  stream  meanders.  Figure 
5  shows  a  sample  watercourse  theme  and  Figure  6  is  the  slice  where 
minor  gaps  have  been  bridged. 

1.  Skeletonizing  Features  via  Gradient  Zero  Crossing 
Several  attempts  were  made  to  utilize  linear  spatial  operators  to 
locate  feature  centerlines.  The  results  were  less  than  satisfactory, 
and  many  problems  remain  to  be  addressed,  but  the  use  of  differentiating 
operators  on  grey  level  Images  generated  from  smoothed  themes,  does 
present  some  Interesting  possibilities. 

A  binary  watercourse  theme  Is  first  changed  by  low  pass  filtering. 

Into  a  continuous  grey  level  image  with  a  continuous  first  derivative. 

In  this  smoothed  Image,  the  watercourse  center  Is  characterized  by  a 
local  Intensity  maximum  which  defines  a  ridge  line  curve  where  the 
local  gradient  taken  perpendicular  to  the  watercourse  direction  changes 
sign  as  It  passes  through  zero.  Zero  crossing  Is  a  uniquely  descriptive 
feature  which  Is  Independent  of  the  watercourse  width,  and  also  Independent 
of  the  gray  level  magnitude  corresponding  to  the  watercourse.  As  long 
as  the  smoothing  operator  has  established  some  non  zero  grey  level 
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connection  betMeen  wtercourse  pixels,  a  gradient  zero  crossing  line 
will  exist  and  can  be  located.  Mapping  the  zero  crossing  can  be  achieved 
by  level  slicing  all  negative  (or  positive)  pixel  values  and  then 
outlining  the  area  napped  by  the  slice.  Figure  7  is  a  schematic  of 
the  processing  sequence. 

/ 

The  zero  crossing  line  has  some  very  attractive  features: 

e  As  long  as  the  filter  size  Is  greater  than  one  half 
the  watercourse  width,  gradient  zero  crossing  will 
occur  at  the  watercourse  centerline. 

e  The  zero  crossing  line  tends  to  establish  and  maintain 
connectivity  across  small  gaps  In  the  watercourse. 

e  The  line  can  be  quickly  and  easily  mapped  Into  a 
single  pixel  width  feature. 

Despite  the  promise  of  this  method,  only  limited  success  was  achieved 
when  applied  to  real  Images.  The  method  was  useful  on  spatially 
simple  watercourses  I.e.  those  without  meanders,  where  the  entire 
stream  could  be  projected  In  some  direction  with  a  one  to  one  mapping, 
allowing  the  use  of  a  single  gradient  direction,  as  Is  shown  In  Figure 
8.  The  method  could  be  used  on  similar  features  with  limited  curvature. 
Whenever  the  range  of  curvature  direction  was  greater  than  a  semicircle, 
the  method  was  unsuccessful.  The  problem  reduces  to  one  of  preserving 
some  of  the  properties  of  a  direction  sensing  operator  while  making  the 
operator  work  over  the  Image  In  a  directionally  invariant  manner.  There 
Is  likely  a  solution  which  would  make  the  method  universally  applicable, 
but  during  this  project,  time  limitations  brought  an  end  to  the  Investigation 

Most  of  the  obvious  adaptations  of  the  gradient  method  were  tried. 

Taking  gradients  from  two  directions  and  then  combining  the  result  Into 
an  Image  where  grey  scale  was  related  to  gradient  magnatude  failed.  In 
general  connectivity  was  not  well  preserved,  and  It  was  lost  at  every 
stream  junction  point.  Likewise,  treating  orthogonal  directions  Indepen¬ 
dently  failed.  This  approach  produced  results  which  were  not  totally 
coincident  and  thus  could  not  be  recombined  to  form  a  single  centerline. 
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(1)  Original  Uatercourse 
Thame 

(2)  Smoothed  Thame 

(3)  Sliced  Smoothed  Theme 

(4)  Gradient  of  Smoothed 
Thome 

(5)  Sliced  Negative  Gradient 

(6)  Outline  Gradient  Slice 

(7)  logical  Combination  of 
of  (6)  and  (3) 
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(A  single  pixel  width 
Watercourse  alignment  map) 


Reduction  of  an  unconnected  watercourse  theme  to  a  single  pixel  width 
watercourse  alignment  map  by  using  lovt  pass  filtering  and  zero  crossing 
of  gradient. 


Figure  7.  Processing  Sequence  for  Skeletonizing 
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Figure  8.  Watercourse  Skeletonizing  by  Gradient 
On  Spatially  Simple  Stream 


The  most  Interesting  approach,  which  alto  failed,  was  to  use  a 
rotating  gradient  operator.  With  a  3  x  3  pixel  moving  operator 
four  gradients  arranged  In  a  semicircle  were  extracted.  Outppt  of  the 
operator  was  the  signed  magnitude  of  the  gradient  possessing  the  greatest 
absolute  value.  The  Idea  was  to  always  extract  the  gradient  In'  a 
direction  perpendicular  to  the  watercourse  so  that  the  zero  crossing 
line  would  be  preserved,  even  when  the  gradient  sign  was  reversed. 
Unfortunately  the  operator  generated  unacceptable  discontinuities 
whenever  the  watercourse  direction  was  oriented  perpendicular  to  the 
line  defining  the  semicircle.  See  Figure  9. 

2.  Skeletonizing  Features  via  Golay  Processing 

Golay  processing  Is  a  purely  spatial  logical  operation  which  Is  applied 
to  a  binary  theme  map.  For  each  pixel  position,  the  operation  examines 
pixels  Immediately  adjacent  to  the  central  pixel,  and  adds  or  deletes 
the  central  pixel  from  the  output  based  on  the  configuration  of  Its 
adjacent  neighbors.  Golay  transforms  were  meant  to  operate  on  Images 
arranged  In  a  hexagonal  array  where  each  pixel  has  six  neighbors.  There 
are  several  significant  advantages  to  this  arrangement  when  compared 
to  t.he  more  connonly  used  rectangular  array.  These  advantages  are: 
fewer  pixels  are  needed  for  spatial  operators,  between  neighbors 
Interpixel  distances  are  constant,  and  a  higher  order  of  symmetry 
exists.  Few  Interactive  systems,  hov«ver,  work  on  hexagonal  arrays, 
making  Implementation  on  these  systems  comp! ex  .  At  CE  DIAL, 
the  transforms  have  been  applied  In  a  compromising  manner  directly 
to  a  rectangular  array,  resulting  In  a  capable  program  but  also  one 
which  has  some  directional  artifacts.  Figure  10  shows  the  Golay 
patterns  as  Implemented  at  DIAL. 

Given  a  connected  watercourse  theme,  Golay  processing  Is  a  reasonable 
means  of  shrinking  the  watercourse  to  the  single  pixel  width  line  needed 
to  Identify  alignment.  Skeletonizing  Is  accomplished  by  deleting  from 
the  watercourse  theme,  all  pixels  with  surrounds  numbers  three,  four, 
and  five  as  labeled  in  Figure  10.  The  operation  basically  removes 
the  outside  annular  ring  of  pixels  from  every  contiguous  area  and  thus 
narrows  the  feature  by  two  pixels  per  pass. 
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Figure  9.  Unsuccessful  Attempt  At  Watercourse  Delineation 
By  Zero  Crossing  Line  Of  Maximum  Local  Gradient. 
Note  That  Discontinuities  Are  Introduced  Only  Then 
Watercourse  Is  Oriented  At  10  o'clock. 


A  problem  with  the  method  results  from  the  small  neighborhood  sampled 
by  the  Golay  surround,  this  or  any  other  rotatlonally  Invarlent  operator 
of  3  X  3  pixels  or  less,  cannot  sense  the  difference  between  .the 
boundary  of  a  large  contiguous  area,  and  a  narrow  linear  feature  two 
pixels  wide.  The  result  can  be  deletion  of  pixels  from  both  sides  of 
the  narrow  feature  and  thus  loss  of  connectivity.  Figure  10  shows 
the  same  watercourse  skeletonized  In  this  manner.  There  are  ways  to 
stop  this  action.  For  example,  slight  smoothing  of  the  feature,  a 
technique  which  has  already  been  recommended  to  establish  connectivity, 
can  also  be  used  to  Introduce  curvature  Into  long  straight  boundaries 
minimizing  occurrence  of  the  malfunction.  Other  techniques,  such  as 
slightly  randomizing  feature  boundaries  have  also  been  used. 

Alternatively,  a  modification  of  the  process  avoids  the  problem,  but 
Introduces  other  effects.  The  Inability  to  recognize  lines  of  two  pixels 
width.  Is  avoided  If  the  process  Is  changed  so  that  Image  raster  lines 
being  processed  are  subjected  to  linnedlate  updating.  With  updating,  when 
ever  an  output  pixel  Is  changed,  the  surround  of  the  subsequent  pixel 
Includes  that  change.  The  compromise  with  this  approach  Is  that  the 
resulting  single  pixel  width  line  Is  no  longer  centered  on  the  feature. 
The  line  Is  Instead  shifted  to  the  side  of  the  feature  which  was  last 
processed.  Even  with  this  undesirable  effect,  the  technique  might  be 
of  value  for  use  on  narrow  watercourses  where  the  Induced  offset  is 
small.  One  very  attractive  feature  of  this  modification  is  that  two 
passes  over  the  Image  are  usually  sufficient  which  can  mean  a  significant 
reduction  of  execution  time.  Figure  11  shows  a  sample  result. 

Based  on  the  approaches  to  skeletonizing  Investigated,  the  use  of 
Golay  pattern  transforms  of  similar  operations  Is  viewed  as  the  more 
promising  means  to  achieve  the  delineation  of  narrow  watercourses. 

The  properties  of  rotational  Invariance,  moderate  execution  time,  and 
a  versatile  selection  of  operations  make  It  useful.  The  main  deficiency 
of  the  approach  Is  that  watercourse  gaps  of  more  than  one  pixel  cannot 
be  easily  bridged,  but  this  can  be  overcome  by  filtering.  Figure  12 
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Figure  12.  Watercourse  Delineation  by  Skeletonizing  the  Hask  In  Figure  6. 
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represents  Golay  skeletonizing  of  the  smoothed  theme,  and 
Is  probably  the  most  successful  skeletonization  exercise.  The  gaps  In 
this  figure  are  largely  a  result  of  the  way  Golay  transforms  are 
currently  Implemented  In  GE  DIAL  with  no  attempt  to  compensate  for  use 
on  a  square  pixel  grid.  These  deficiencies  could  most  likely  be  removed 
with  an  Improved  program. 

C.  Theme  Smoothing  Method 

Categorization  of  Images  by  computer  assisted  methods  produces,  except 
for  the  extraction  of  very  easy  and  distinctly  unique  classes,  results 
that  are  spatially  complex.  The  classification  may  or  may  not  be  "noisy", 
depending  on  the  suitability  of  the  data  for  extraction  of  a  given 
class,  but  w111  In  general  exhibit  a  salt  and  pepper  appearance  which 
might  be  Interpreted  as  noise.  (This  effect  comes  from  the  fact  that 
with  current  technology  computers  perform  relatively  poorly  at  spatial 
tasks.)  Most  of  the  commonly  used  classification  schemes  are  totally 
aspatial ,  relying  on  Intensity  level  In  one  or  more  spectral  wavelenth 
bands,  while  completely  Ignoring  feature  boundalres,  shapes,  and  texture. 
Even  those  methods  which  aspire  to  use  spatial  Information,  for  example, 
the  textural  operators  described  In  this  report,  use  spatial  information 
in  a  very  rudimentary  manner  when  compared  to  the  feature  extraction 
capabilities  of  a  human  Image  Interpreter. 

The  Interpreter,  in  contrast,  has  a  relatively  poor  ability  to  identify 
Image  Intensity  levels  with  any  real  accuracy,  and  relies  very  heavily 
on  his  spatial  abilities,  particularly  when  analysing  monochrome  Imagery. 
As  opposed  to  a  computer  classification,  which  takes  place  on  a  per 
pixel  basis,  the  Interpreter  performs  classification  on  a  per  feature 
basis.  This  leads  to  extraction  of  features  by  the  location  of  their 
external  boundaries  and  tends  to  force  the  classes  Into  contiguous  areas. 
The  Interpreter  tends  to  Ignore  (or  accomodate  for)  minor  variances 
Internal  to  the  feature  which  might  affect  a  computerized  classification, 
and  also  performs  considerable  smoothing  or  straightening  of  feature 
outlines. 
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Deciding  which  of  these  two  radically  different  approaches  Is  more 
accurate  Is  moot,  and  depends  on  ones  definitions  and  objectives. 

Uhat  Is  certain  Is  the  fact  that  the  Interpreter  generally  prpduces 
a  map  that  Is  far  more  suitable  to  the  generation  of  factor  overlays, 
and  If  computer  assisted  methods  are  to  be  used  successfully,  their 
results  must  be  processed  In  a  manner  which  changes  them  Into  a  form 
which  Is  more  compatable  with  factor  overlays.  This  requires  spatial 
low  pass  filtering,  and  occasionally  severe  filtering.  Factor  overlays 
are  very  simple  In  spatial  structure  and  contain  only  enough  Information 
to  locate  and  describe  a  feature  of  tactical  significance.  Since  over¬ 
lays  are  to  ultimately  be  combined,  their  simplicity  becomes  even 
more  Important.  The  combination  of  spatially  complex  overlays  could 
produce  a  result  containing  too  much  Information  to  be  effectively 
understood  and  utilized.  Production  of  overlays  from  computer  generated 
thematic  maps  generally  requires  simulating  the  Integration  and  feature 
selective  filtering  performed  subconslously  by  an  Image  Interpreter. 
Specifically  It  required  the  straightening  of  object  boundaries, 
mapping  the  object  in  a  contiguous  manner,  and  the  removal  of  small 
or  unimportant  features. 

In  Phase  1  of  this  project,  efforts  were  restricted  to  the  application 
of  currently  available  software  tools,  eliminating  the  possibility 
of  a  truly  effective  theme  filter.  The  need  for  one  was,  however, 
clear  In  the  earliest  stages  of  the  project.  Being  able  to  "see  the 
forest  through  the  trees"  was  not  a  cliche,  but  was  the  definition 
of  a  major  problem.  Extracting  forest  boundaries  meant  elimination 
of  high  resolution  microstructure  within  the  desired  feature  without 
objectionably  modifying  the  boundary. 

The  approach  used  In  Phase  1,  was  basically  to  apply  an  Image  smoothing 
filter  to  the  Image  as  a  preprocessing  function.  The  smoothed  Image 
was  then  used  to  generate  binary  masks  of  various  features  after  the 
removal  of  feature  microstructure.  Then  the  element  extraction  processes, 
which  generally  required  use  of  microstructure  and  high  resolution  was 
performed  on  the  original  data.  Themes  generated  were  then  restricted 


loan  area  of  the  mask  to  eliminate  misclassificatlon  errors  which  would 
otherwise  be  widespread  and  unacceptable.  While  the  overall  effort  was 
successful,  there  were  serious  problems  that  were  left  to  be  solved. 

The  most  serious  was  that  smoothing  transformed  all  discontinuities  or 
feature  edges  Into  smoothly  flowing  ramps.  Generation  of  several  of 
the  required  masks  resulted  In  a  situation  where  adjacent  thematic 
features  did  not  compliment  or  butt  each  other  properly,  with  the  area 
near  the  feature  butt  line,  corresponding  to  the  high  slope  region  of 
the  ramp,  usually  not  being  placed  Into  the  proper  mask.  A  second  problem 
was  that  the  smoothing  treated  all  objects  equally  as  opposed  to 
considering  the  spatial  characteristics  of  Individual  classes.  For 
example,  narrow  features  such  as  roads,  were  obliterated  by  the  heavy 
smoothing  needed  to  map  the  forest.  Lengthy  work  arounds  were  used 
where  several  degrees  of  smoothing  were  applied,  but  this  was  not  an 
effective  solution. 

As  a  result  of  the  Phase  1  effort,  a  series  of  requirements  were  Identi¬ 
fied  for  a  post  processing  filter  to  work  not  on  grey  level  Images, 
but  on  the  themes  generated  from  the  Images.  The  advantages  of  the 
post  processing  are  many  and  are  basically  related  to  the  fact  that  all 
resolution  Is  maintained  and  utilized  as  needed  during  the  element 
extraction  process.  Only  after  the  Image  has  been  reduced  to  the 
desired  themes.  Is  the  filtering  applied.  Post  processing  solves  the 
mentioned  ramp  problem  by  totally  avoiding  the  generation  of  ramps, 
and  the  problem  of  selective  filtering  Is  handled  more  easily  after 
categorization  as  the  features  have  been  Identified. 

Processing  problems  to  be  solved  by  a  post  processing  filter: 

e  Theme  Simplification  -  The  severity  of  the  filtering  action 
should  be  user  specifiable  to  achieve  the  desired  amount  of 
boundary  smoothing.  Capabilities  should  Include  extreme  low 
pass  filtering. 

•  Theme  Selective  Filtering  -  All  themes  are  not  created  equal, 
and  the  filter  must  treat  individual  themes  in  Individual 
manners.  Methods  must  be  provided  for  the  restriction  of 
growth,  shrinkage  or  change  for  any  particular  theme. 
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•  Theme  Butting  >  The  filter  should  be  able  to  annihilate  areas 
between  adjacent  features  of  Interest  which  commonly  result 
from  classification  errors  or  from  the  presence  of  Incidental 
features  such  as  shadows. 

e  Contiguous  Area  Thresholding  -  The  filter  should  be  capable 
filtering  by  object  size  to  allow  removal  of  Islands  and/or 
holes  from  any  designated  theme. 

In  the  Interest  of  reasonable  execution  times,  the  use  of  box  filtering 
techniques  were  nearly  dictated  for  the  theme  filter.  The  filter  must 
basically  count  the  number  of  times  each  theme  occurred  In  each  local 
neighborhood.  Each  of  the  themes  Is  then  ranked,  based  on  Its  local  occur- 
rance  rate  In  conjunction  with  operator  designated  replacement  constraints, 
as  a  candidate  for  being  replaced  and  for  being  a  possible  replacement 
for  others.  The  key  theme  (the  on'  cloned  In  the  center  of  the  filter 
area  at  any  given  time)  Is  then  replaced  by  the  theme  at  the  top  of  the 
ranking  hierarchy.  In  the  absence  of  operator  Input  constraints  the  key 
theme  Is  replaced  by  the  one  most  common  In  the  neighborhood.  To  perform 
this  operation  means  tabulating  running  areal  totals  for  each  of  the 
themes  being  processed,  and  could  amount  to  an  excessive  number  of 
calculations  with  clumsy  Implementation.  Box  filtering,  with  Its 
ability  to  operate  with  filters  of  any  reasonable  size  without  appreciable 
execution  time  penalties.  Is  Ideally  suited  to  the  task.  Keeping  running 
totals  with  box  filters  even  retired  less  computation  than  their  usual 
use,  which  Is  keeping  running  averages.  As  with  the  running  averages, 
the  minor  artifacting  Introduced  by  the  use  of  a  square  spatial  operator. 

Is  outweighed  by  the  computational  efficiencies. 

Figure  13  shows  the  theme  filter  main  program,  and  Figure  14  shows  the 
data  structure  used.  Note  that  the  progran  Is  set  up  to  handle  eight 
themes,  but  nine  different  categories.  Theme  #0  refers  to  uncategorized 
pixels  or  those  not  In  any  of  the  eight  themes.  In  retrospect,  even 
another  category  marking  multiply  classified  pixels  or  those  contained 
In  more  than  one  theme  would  have  been  useful. 


33 


Figure  12.  Theme  Filter 
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Figure  14.  Theme  Filter  Data  Structure 
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The  box  filtering  approach  Is  not  unique  In  theme  processing,  but  as 
commonly  used  It  Is  not  sufficient  to  satisfy  the  theme  processor 
requirements.  Used  without  replacement  constraints.  It  Is  not  versatile 
enough  to  perform  a11  the  desired  theme  manipulation  possibilities.  Box 
filtering  Is  simply  an  effective  method  of  providing  Information  ^to  the 
•real  heart  of  the  theme  processor,  the  theme  replacement  logic. 

Interactive  control  of  the  theme  filter  Is  accomplished  by  setting 
theme  population  thresholds  which  must  be  exceeded  before  a  given 
theme  Is  modified,  with  separate  thresholds  for  theme  growth  and  for 
theme  shrinkage.  The  filter  can  thus  be  set  up  to  treat  themes  uniquely 
when  needed.  Whenever  the  shrink  threshold  Is  passed,  the  key  pixel  Is 
replaced  by  the  most  common  growable  theme.  See  Figure  IS. 

Considerable  effort  went  Into  the  operator  Interface.  Its  purpose 
Is  to  assist  the  operator  In  the  task  of  setting  up  fairly  complex 
filtering  options.  The  filter  has  numerous  Input  parameters,  whose 
Input  Is  tedious  and  has  a  high  potential  for  error.  Also,  since  the 
filtering  action  on  a  given  theme  Is  determined  not  only  by  the 
thresholds  directly  associated  with  that  theme,  but  also  by  the  thresholds 
of  Its  possible  replacements,  the  Interaction  between  these  Input 
parameters  Is  not  always  obvious.  The  Interface  is  designed  to  minimize 
confusion  along  with  tedious  repetitive  Input.  The  filter  Is  set  up  to 
operate  In  an  Iterative  manner.  Allowing  either  continuing  with  the 
filtering  or  reworking  the  last  operation  if  undesirable  results  appear. 
The  filter  executes  fast  enough  so  that  an  operator  can  observe  and 
analyze  the  result,  and  then  rerun  the  filter  with  modified  thresholds 
or  box  size  to  better  achieve  his  purpose. 

Figure  16  Is  a  verification  display  for  the  Interface,  listing  current 
threshold  settings  along  with  a  computer  generated  verbal  estimate  of  the 
resulting  filtering  action. 
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Figure  15.  Theme  Filter  Replacement  Logic 
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Figure  16.  Theme  Filter  Operator  Interface 


D.  Use  of  the  Theme  Filter 

In  the  pursuit  of  water  resources  element  extraction  It  was 
established  that  the  theme  filter  was  effective  In  solving  a  host  of 
Image  categorization  problems.  The  most  severly  limiting  factor  In  Its 
usage  seems  to  be  the  limited  ability  of  the  analyst  to  correctly  forcast 
the  action  of  the  filter  and  to  be  able  to  specify  the  set  of  Interrelated 
thresholds  needed  to  perform  the  desired  function.  Several  common 
Image  categorization  problems,  along  with  suggested  and  proven  solutions 
making  use  of  the  theme  filter,  are  listed  below: 

1.  Capabilities 

a.  General  Theme  Smoothing 

Application:  Spatially  simplify  theme  so  that  they  may  be 
depicted  by  line  maps. 

Procedure:  Run  filter  with  default  thresholds  so  that  each  theme 

Is  replaced  by  the  locally  most  common.  For  best 
results,  run  the  filter  twice  to  Insure  no  linear 
artifacts  are  generated  by  the  rectangular  filter. 

b.  Annihilation  of  Certain  Themes 

Application:  Often  It  Is  desirable  to  totally  eliminate 
Irrelevant  themes  (shadows  for  example). 

Procedure:  a  Enter  a  negative  threshold  for  the  theme  to 

be  annihilated. 

a  Leave  all  other  thresholds  default 

The  theme  filter  has  a  replacement  flag  set  by 
entering  a  negative  threshold.  This  flag  stops 
the  theme  from  being  considered  as  a  possible 
output. 

c.  Preserving  Certain  Themes  While  Filtering  Others 
Application:  Very  accurately  mapped  themes,  or  sparce  filament 

themes  (roads,  etc.)  should  not  be  changed.' 

Procedure:  a  Set  grow  above  threshold  to  lOOX  so  that  theme 

will  not  grow. 

a  Set  shrink  below  threshold  to  o%  so  that  theme 
will  not  shrink. 
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d.  General  Noise  Cleaner 

Application:  Most  spatially  derived  themes  are  Improved  by 

eliminating  Isolated  pixels  which  often  represent 
noise. 

/ 

Procedure:  Set  thresholds  for  all  themes  to  grow  above  33% 

and  shrink  below  11%,  then  run  a  3  x  3  pixel  filter. 

The  11%  threshold  locates  totally  Isolated  pixels, 
while  the  33%  threshold  Insures  there  Is  a  locally 
dominant  class  before  replacement.  By  enlarging  the 
filter  size  this  operation  can  be  used  to  remove 
larger  areas  (Islands  and  holes). 

e.  Resolving  Theme  Overlap  or  Underlap 

Application:  Image  classification  virtually  always  results  In 
some  error  as  signatures  are  so  unique.  Problem 
areas  often  show  up  as  unclassified  or  multiply 
classified  pixels.  A  satisfactory  solution  Is  to 
remap  these  poorly  classified  pixels  on  a  purely 
.  spatial  basis. 

Procedure:  e  Place  pixels  to  be  resolved  Into  a  separate  theme 

e  Set  replacement  flag  for  that  theme 
e  Leave  default  thresholds  for  all  other  themes 

2.  Processing  Example 

To  demonstrate  the  filtering  capability,  one  of  the  panchromatic  scenes 
used  In  the  first  phase  of  this  project  was  recategorized  with  considerable 
Improvement.  The  following  processing  sequence  was  followed  and  results 
are  shown  In  Figure  17. 

a.  The  scene  was  categorized  on  the  basis  of  gray  level  and  microtexture. 
This  task  was  some  what  easier  than  with  the  previous  effort  because 
the  filter  will  contiguously  map  locally  predominant  classes  allowing 
less  descrimlnative  signatures  to  be  used. 
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Figure 

Theme  From  Phase  1 


Figure  17.  Comparison  of  Fort  Belvoir/Woodbridge  Vegetation 
Themes  Derived  by  Interactive  Computer  and  Manual 
Interpretation. 


b.  Areas  categorized  as  shadows  were  eliminated  by  the  filter  based  on 
operator  Interpretation.  Two  passes  were  used:  (1)  when  a  shadow 
occurred  within  a  short  distance  to  water,  the  shadow  was  changed 
to  water  producing  considerable  Improvement  In  the  river  shoreline 
and  bridge  area,  and  (2)  shadows  not  near  water  were  mapped  fLo  the 
locally  most  common  class. 

c.  The  scene  was  then  smoothed  by  a  5  x  5  pixel  filter  to  produce  a 
categorization  comparable  to  what  must  be  done  by  a  photo  Inter¬ 
preter.  The  "bare"  category  was  restricted  from  change  so  that 
the  roads  would  be  preserved.  See  Figure  ICA  and  19. 

d.  To  demonstrate  severe  filtering,  the  categories  were  then  processed 
with  an  11  X  11  pixel  filter.  See  Figure  IBB  and  20. 

allows  virtually  any  degree  of  filtering  to  be  achieved  with  about 
the  same  execution  time.  In  working  situation,  the  desired  amount 
of  filtering  might  be  determined  by  scene  complexity,  desired 
scale,  or  Intended  use. 

e.  Both  of  the  products  were  reduced  to  line  maps  via  Golay  processing 
(e'ssentlally  automated).  Each  theme  was  outlined,  the  outlines 
were  combined  to  produce  double  width  lines,  and  then  the  lines 
were  shrunk  to  a  single  pixel  width. 
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Figure  18B 
Simplified  Themes 


Figure  18.  Results  of  Theme  Filtering 
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Figure  20. 
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Outlines  of  Simplified  Themes 
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IV.  RESULTS 

A.  Extraction  of  Watercourses  and  Associated  Elanents 
1.  Matercourses 

a.  Extracting  Watercourses  From  Panchromatic  and  Thermal  Imagery 

/ 

The  Knobbs  Creek  Imagery  mas  selected  for  analysis  and  development  of 
techniques  because  It  contained  data  coverage  from  both  thermal  IR  and 
panchromatic  photographic  sensors.  Knobbs  Creek  Is  a  good  test  for 
watercourse  classification  In  that  the  coverage  contains  a  wide  range 
of  watercourse  widths.  It  provides  a  difficult  test  as  the  creek  Is  - 
almost  100%  surrounded  by  large  trees.  This  does  not  provide,  however, 
the  best  diversity  of  surrounds  with  which  to  test  watercourse  Identifi- 
.  cation.  The  Ideal  test  would  Involve  a  scene  having  many  watercourses 
surrounded  by  a  variety  of  land  cover,  and  having  a  wide  range  of  water- 
.course  widths. 

Knobbs  Creek,  being  surrounded  by  forest,  creates  problems  for  both 
machine  and  manual  analysis.  The  creek  Is  obscured  by  forest  when 
watercourse  width  Is  less  than  approximately  5  meters.  In  these  situations, 
analyst  Inferred  watercourses  will  be  necessary.  Further,  the  deter¬ 
mination  of  dry  gap  widths  Is  hindered  by  the  encroaching  forest  and 
by  shadows  from  adjacent  forest  which  extend  across  the  watercourse. 

The  shadows  create  an  additional  problem  for  machine  analysis  by  completely 
or  partially  covering  the  watercourse  (depending  on  watercourse  width 
or  direction).  This  requires  the  machine  analyst  to  derive  a  signature 
for  water  and  a  signature  for  shadow  which  must  be  added  together  to 
enable  Identification  of  the  entire  watercourse.  Unfortunately,  the 
signature  contains  areas  which  are  not  watercourses  (forest  shadows  within 
the  forest). 

Eight  (512  X  512  pixel )  subscenes  were  digitzed  at  GE  DIAL  from  three  of 
the  1:100,000  scale  thermal  IR  transparencies  of  Knobbs  Creek.  Four  of 
these  were  digitized  from  4  In.  x  4  In.  areas  In  the  transparency 
(ground  resolution  approximately  2  meter)  and  four  from  1  In.  x  1  In.  areas 
(ground  resolution  approximately  0.5  meter).  In  addition,  four  (512  x  512 
pixel)  subscenes  were  digitized  at  6E  DIAL  from  the  1:250,000  scale  panchromatic 
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photographic  Image  of  Knobbs  Creek.  Two  of  these  were  digitized  from 
4  In.  X  4  In.  areas  (ground  resolution  approximately  4  meter)*  and  two 
from  1  In.  X  1  In.  areas  (ground  resolution  approximately  1  meter)*. 

These  resolutions  were  chosen  for  Initial  tests  of  watercourse  1dent1> 
ficatlon  to  provide  an  appropriate  range  of  resolution  for  testing  the 
spatial  filters  used  In  watercourse  extraction. 

The  Initial  step  In  the  Investigation  was  to  Identify  whether  gray  level 
density  slicing  would  be  sufficient  to  Identify  watercourses.  Several 
problems  were  encountered  In  this  step: 

•  This  thermal  IR  Imagery  appears  to  contain  dark  and  light  bands 
which  are  apparently  caused  by  automatic  gain  and  offset  In  the 
sensor  which  are  adjusted  by  scan  content.  This  has  the 
undesirable  effect  of  causing  forest  and  watercourse  signatures 
from  different  areas  of  the  scene  to  appear  similar  and  thus 

be  recognized  simultaneously. 

•  Both  thermal  IR  and  panchromatic  photographic  digital  Images 
exhibit  a  shading  across  the  Image  which  cause  signatures  to 
overlap. 

Gray  level  density  slicing  of  either  the  thermal  or  the  panchromatic 
photographic  digital  Images,  In  order  to  extract  watercourses,  produced 
unacceptable  results.  Figures  21  and  23  show  the  watercourse  themes 
extracted  from  the  panchromatic  photographic  Images,  and  similar  poor 
results  were  obtained  with  the  thermal  Images. 

At  this  point,  several  spatial  filters  were  applied  to  all  digital  Images. 
The  Images  resulting  from  use  of  these  filters  have  high  spatial  frequency 
noise,  however,  which  requires  a  subsequent  smoothing  operation.  Best 
smoothing  results  appear  to  be  produced  with  the  7x7  pixel  moving  average. 
Some  of  the  spatial  operations  tested  Include:  5-p1xel  cross  mln-max 
texture;  the  original  Image  minus  a  7  x  7  pixel  local  average;  3x3 
pixel  Laplaclan. 

^  In  this  report,  the  term  resolution  Is  used  to  describe  the  actual 
dimensions  of  the  smallest  resolvable  objects  In  an  Image. 
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Figure  21.  Watercourse  Extraction  via  Level  Slicing  The 

1-meter  Resolution  Panchromatic  Photographic  Image. 
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Figure  23.  Watercourse  Extraction  via  Level  Slicing  The  4-fteter 
Resolution  Panchromatic  Photographic  Image 


Results  when  using  the  spatially  processed  Images  Jointly  with  the  original 
digital  Images  (I.e.,  two  dimensional  classification)  can  be  summarized 
as  follows: 

e  Best  results  for  1  meter  resolution  panchromatic  photographic 
and  0.5  meter  resolution  thermal  IR  Images  were  obtained  with 
the  5-p1xel  Cross  mln-max  texture  operator, 
e  Best  results  for  4  meter  resolution  panchromatic  photographic 
and  2  meter  resolution  thermal  IR  Images  were  obtained  with  the 
original  Image  minus  the  7x7  local  average. 

Figure  22  shows  the  result  of  watercourse  Identification  using  the  1  meter 
resolution  panchromatic  photographic  Image  and  Its  texture  version.  In 
Figure  24, watercourse  Identification  Is  shown  for  the  case  when  4  Meter 
resolution  panchromatic  photographic  Image  and  the  smoothed  result  of 
Image  minus  a  7  x  7  pixel  local  average  are  used.  Figures  23  and  26  show  the 
actual  location  of  the  watercourse.  Comparison  of  actual  and  machine-extracted 
watercourses  Indicates  shadow  areas  In  both  scenes  which  are  falsely 
Included  In  the  watercourse  theme. 

Similar  results  were  obtained  with  the  digitized  thermal  Imagery. 

2.  Extracting  Watercourses  from  Radar  Imagery 

Four  subscenes  of  512  x  512  pixels  depicting  X-Band  vertical  and  horizontal 
polarization;  and  L-Band  vertical  and  horizontal  polarization  were  made. 

Figures  25,  26,  27,  and  28  are  Illustrations  of  the  subscenes  as  displayed 
on  the  cathode  ray  tube  (CRT).  The  data  are  shown  Inverted  to  a  negative. 
Geographic  scene  locations  are  shown  In  Figure  29. 

In  Figures  30,  31,  32  and  33  theme  results  were  obtained  by  sensity  slicing 
the  data.  Figure  34  subscene  Is  the  same  as  Figure  25.  It  Is  repeated 
to  allow  for  comparison  relative  to  the  processes  subscenes  In  Figures  35, 

36  and  37.  In  Figure  35,  the  subscene  Illustrates  the  application  of 
the  7x7  moving  average  operator  on  the  X-Band  horizontal  polarization 
data.  Figure  36  shows  the  derived  associated  microtexture  Image  derived 
from  X-Band  horizontal  polarization  data. 
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Figure  24.  Watercourse  Identification  via  Joint  Use  of  the  4-Keter  Resolution 
Panchromatic  Photographic  Image  and  the  Result  of  the  Image  Minus 
7x7  Pixel  Local  Average. 
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Figure  25  -  X-Band  Horizontal  Polarization  Figure  27  -  L-Band  Horizontal 

Subscene  Polarization  Subscene 


Figure  26  -  X-Band  Vertical  Polarization 
Subscene 


Figure  28  -  L-Band  Vertical 

Polarization  Subscene 
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Figure 29.  SAR  Data  and  Subscene  Locations. 


Figure  30.  Water  Theme  Sliced  From  X-Band  SAR  w/Horizontal  Polarization. 
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Figure  31.  Water  Theme  Derived  From  X-Band  5AR  w/Horizontal  Polarization. 
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Figure  32.  Water  Theme  Derived  From  X-Band  SAR  w/Horizontal  Polarization. 


Figure  33.  Hater  Theme  derived  from  L-Band  SAR  w/vertical  polarization 


Figure  34  -  X-Band  Horizontal 

Polarization  Subscene 
(Same  as  Figure  1) 

Figure  35  -  X-Band  Horizontal 

Polarization  Data  Smoothed 
by  a  7x7  Pixel  floving 
Average  Operator 


Figure  36  -  Associated  Microtexture 
Image 


Figure  37  -  Microtexture  Image  Data 
Smoothed  by  a  7x7  Pixel 
Moving  Average  Operator 
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Figure  37  shows  the  results  of  smoothing  the  microtexture  Image  data 
with  a  7  X  7  pixel  moving  average  operator.  In  Figure  38,  X>Band  SAR  horizontal 
polarization  data  and  the  associated  microtexture  Image  are  shown  cate¬ 
gorized  by  a  two  dimensional  partitioning  classifier.  This  procedure 
appears  to  provide  clearer  results  than  density  slicing  the  SAR  data  only. 
Figure  39  Illustrates  the  categorization  of  water  courses  and  water 
bodies  using  the  two  dimensional  partitioning  classifier  with  the  X-Band 
SAR  horizontal  polarization  data  and  the  texture  data  smoothed  by  a  7  x  7  pixel 
moving  average  operator.  It  appears  that  another  degree  of  clarification 
Is  achieved  with  this  method.  In  Figure  40,  X-Band  SAR  horizontal 
polarization  data  are  smoothed  by  a  7  x  7  pixel  moving  average  operator  and 
density  sliced  Into  a  theme  for  watercourses  and  water  bodies.  Apparently 
this  procedure  provides  the  best  definition  of  watercourses  and  water 
bodies. 

3.  Watercourse  Extraction  Using  Combinations  of  Dissimilar  Images 
A  data  set  of  panchromatic,  low  resolution  Thermal  IR  and  SAR  (two 
flight  directions)  Images  were  digitized  at  5  meter  resolution  and 
registered  for  Little  River  and  New  Begun  Creek  water  courses.  Different 
combinations  of  data  from  the  set.  Including  microtexture  derived  data 
(from  panchromatic  Images)  were  used  for  the  extraction  of  water  course 
themes.  The  low  resolution  Thermal  IR  data  did  not  have  a  significant 
contribution  to  the  derivation  of  the  watercourse  themes.  From  the 
analysis  of  a  combination  of  the  panchromatic  Images  and  the  microtexture 
(derived  from  the  panchromatic  Images)  data  a  conflict  between  shadows 
and  water  existed.  Radar  Imagery  was  used  to  resolve  some  of  the 
shadow  conflict.  Derived  watercourse  themes  for  Little  River  are  shown 
In  Figures  41,  42  and  43.. 

A  comparison  of  watercourse  themes  which  were  derived  from  different 
combinations  of  Chapel  Creek  (upper  Little  River  area)  panchromatic, 
radar,  and  the  microtexture  data  (derived  from  the  panchromatic  Images) 
are  shown  In  Figures  44,45,  46  and  47. 
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Figure  39.  Water  Theme  Derived  From  2-D1mens1na1  Partitioning  of  X-Band  SAR 

w/HorIzontal  Polarization  Data  and  Textured  Data  Smoothed  By  a  7  x  7 
Pixel  Moving  Average  Operator. 


Figure  40.  Theme  Derived  From  the  7  x  7  Pixel  Smoothed  Version  of  the  X-Band 
SAR  Image  w/HorIzontal  Polarization. 
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Figure  42.  Smoothed  Version  of  Figure  41. 
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Figure  45.  Chapel  Creek  Watercourse  Theme  Derived  from 
Panchromatic  Photography  and  SAR  Data  and 
from  the  Smoothed  Microtexture  Version  of  the 
Photography. 
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4.  Watercourse  Extracting  Using  Panchromatic  Imagery  Digitized  of 
•  Various  Scales 

A  section  of  the  panchromatic  Image  of  the  Chapel  Creek  watercourse  was 
digitized  at  multiple  scales  to  determine  what  resolution  of  the  derived 
micro-texture  data  contains  the  most  separable  watercourse  class.  Prelimi¬ 
nary  results  Indicate  that  panchromatic  resolution  between  1  and  ^  meters 
yields  microtexture  data  which  best  discriminates  the  watercourse  class. 
This  also,  to  some  degree,  verifies  results  for  vegetation  extraction 
where  similar  panchromatic  resolutions  yielded  micro-texture  data  which 
contained  best  separability  of  vegetation  classes, 
e  Alignment  of  all  Water  Bodies 

Given  a  suitable  thematic  classification  of  a  watercourse, 
the  alignment  or  centerline  can  be  extracted  by  the  methods 
detailed  In  Section  III.  Figure  12  shows  the  alignment  of 
watercourse  as  extracted  by  the  Golay  method, 
e  Shore  Alignment  of  all  Water  Bodies 

This  Is  a  relatively  easy  task  once  water  bodies  have  been 
categorized.  In  fact,  the  recommended  procedure  Is  tolerant 
of  classification  errors  of  the  omission  type  and  required 
only  a  mediocre  water  body  theme.  The  theme  Is  filtered  as 
required  to  generate  a  contiglous  map  by  using  the 
theme  filter  or  a  similar  operation,  and  Is  then  outlined 
by  the  Golay  process*  Figure  47  shows  a  sample  alignment  theme. 

B.  Extraction  of  Dry  Gaps  and  Associated  Elements 
1.  Dry  Gaps 

Much  of  the  effort  Involved  In  producing  watercourse  factor  overlays 
deals  with  dry  gap  width,  which  Is  defined  as  the  distance  between  stream 
bank  shoulders.  These  width  measurements  are  not  usually  derivable  from 
a  single  image.  The  Terrain  Analysis  Procedural  Guide  for  Drainage  and 
Mater  Resources  lists  two  methods  of  determining  dry  gap  I.e  (1)  use  of 
topographic  Information  to  locate  lines  of  high  elevation  gradient  along 
the  stream  bed  and  (2)  locate  the  shoulder  by  photo  Interpretation  of 
stereo  pair.  While  there  are  Interesting  possibilities  for  Implementing 
either  of  these  approaches  on  an  Interactive  system,  no  suitable  Imagery 
was  available  resulting  In  development  efforts. 
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without  elevation  Information,  the  extraction  of  dry  gaps  Is  a  task  best 
left  to  the  Interpreter  because  of  the  large  amount  of  Judgement  required. 

Dry  gap  outlines  can  be  quickly  entered  Into  digital  storage  by  using 
a  pen/tablet  or  cursor  In  conjunction  with  an  Image  display.  Admittedly 
this  Is  an  Inelegant  solution,  but  It  Is  also  practical.  Dry  gaps  can 
be  located  more  easily  on  the  basis  of  vegetation  and  land  fonr  Inter¬ 
pretation,  than  by  any  unique  machine  extractable  methods. 

Once  a  watercourse  and  Its  associated  dry  gap  have  been  satisfactorily 
mapped  Into  themes  by  whatever  means.  Interactive  or  automated,  generation 
of  factor  overlays  containing  watercourse  delineation  and  categorization 
still  entails  a  series  of  tasks  which  are  labor  Intensive  and  fairly 
tedious.  Tasks  which  could  be  done  effectively  by  computer  Include,  the 
classification  of  water  course  segments,  dry  gap  width,  encoding  of  water 
course  delineations  by  class,  and  the  location  of  terminal  points. 

Even  with  the  unfeasabll Ity  of  extracting  dry  gaps  from  the  available 
Imagery,  It  was  felt  that  Interactive  computer  methods  could  be  of  value 
In  the  extraction  of  these  elements  rather  than  not  investigate  the 
elements,  some  analysis  was  performed  with  a  manually  extracted  dry  gap 
as  a  starting  point. 

To  demonstrate  some  of  the  potential  tasks,  a  panchromatic  image  of 
Tennessee  was  used.  The  scene  contained  an  unusually  diverse  set  of 
watercourses  with  dry  gap  widths  ranging  from  less  than  3  to  greater 
than  50  meters.  Both  the  watercourse  outline  and  dry  gap  outline  viere 
classified  by  manual  means  with  an  operator  moving  a  joystick  controlled 
cursor  over  the  Image. 

While  the  resulting  dry  gap  theme  probably  contains  errors.  It  Is  typical 
of  what  can  be  done  on  the  basis  of  land  form  and  vegetation  analysis  with 
no  available  elevation  data.  Figure  48  and  49  show  the  results 

2.  Categorizing  Watercourse  bv  Dry  Gao  Width 

A  sequence  which  could  lend  Itself  to  automated  processing  can  be  used 
with  watercourse  and  dry  gap  themes  stored.  The  first  step  Is  to  employ 
a  pixel  stripping  algorithm  such  as  the  Golay  processor  to  locate  the 
center  line  (delineation)  of  both  themes.  Figure  50  and  51  show  the  results 
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Figure  48.  Manually  Interpreted  Watercourse 
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for  this  particular  iMge.  These  results  have  been  touched  up  to  correct 
some  of  the  previously  discussed  problems  Introduced  by  the  Golay 
skeletonizing  algorithm  as  It  Is  currently  Implemented  on  GE  DIAL. 

A  correction  Is  needed  to  the  algorithm  which  assures  skeletonizing  to 
a  single  pixel  width  line  with  no  loss  of  connectivity. 

The  next  step  basically  measures  dry  gap  width  along  the  entire  weter 
course  by  reapplying  the  Golay  process  to  strip  from  the  dry  gap  theme, 
annular  rings  of  pixels  corresponding  to  the  desired  width  Increments. 

In  contrast  to  the  previous  process,  the  dry  gap  Is  not  skeletonized 
butts  allowed  to  disappear  as  the  stripping  continues.  Five  sequential 
applications  of  stripping  can  be  used  to  yield  a  set  of  themes  showing 
areas  of  dry  gap  greater  than  3,  10,  18,  25  and  35  meters. 

These  themes  are  then  logically  combined  with  the  dry  gap  center  line 
producing  a  series  of  center  line  segments  where  each  segment  maps  a 
dry.  width  Interval.  Figure  52  Is  a  flow  chart  describing  the  algorithm 
segments. 


The  desired  final  result  Is,  of  course,  not  a  categorized  dry  gap  center 
line,  but  Is  a  categorized  watercourse  center  line.  The  final  steps 
of  the  sequence  address  this  problem.  A  new  set  of  themes  must  be  generated, 
which  categorize  the  entire  area  covered  by  the  dry  gap  Into  segments 
by  width  Interval.  This  Is  accomplished  by  applying  the  theme  filter  to 
the  dry  gap  and  Its  center  line  segments.  Filter  constraints  are  set 
up  so  that  the  dry  gap  theme  Is  totally  replaced  with  the  theme  corres¬ 
ponding  to  the  closest  center  line  segment.  Finally,  this  set  of  themes 
Is  logically  combined  with  the  watercourse  center  line  (or  boundaries) 
to  produce  the  desired  categorization.  See  Figures  53  and  54. 

3.  Terminal  Points  of  Watercourse  Segments 

At  this  point  In  the  suggested  processing  sequence,  we  have  suposedly 
performed  a  successful  categorization  of  the  watercourse  based  upon  Its 
associated  dry  gap  width.  The  result  Is  a  series  of  themes,  each 
containing  segnents  of  the  watercourse  delineation  (centerline)  corres¬ 
ponding  to  a  given  dry  gap  width  Increment.  From  any  of  these  themes 
It  Is  a  simple  matter  to  locate  end  points  of  the  segments. 


Figure  52.  Categorizing  a  Dry  Gap  By  Width 


Figure  54.  Combining  Watercourse  Center  Line  With  Dry  Gap 
Categories.  Performing  a  Logical  Intersection 
Produces  Watercourse  Segments  Categorized  Width. 
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Golay  processing  Is  a  very  straight  forward  means  of  finding  segment 
end  points.  The  procedure  Is  to  operate  on  the  desired  width  Increment 
theme  by  deleting  all  pixels  with  surrounds  containing  more  than  one 
pixel.  Using  the  numbering  convention  In  Figure  10,  surrounds. 2  thru 
4  would  be  set  for  deletion.  The  output  theme  contains  only  the  end  points 
of  connected  segments  In  the  Input  theme.  The  operation  Is  completed  In 
one  pass  over  the  Image  and  Is  Independent  of  the  number  of  segments  being 
processed . 

For  the  end  points  of  watercourse  segments  with  less  than  three  meter  dry 
gaps  an  additional  operation  may  be  desirable.  In  this  case,  both  terminal 
points  of  the  segments  are  not  used  In  factor  overlays,  only  the  points 
where  the  watercourse  transitions  to  greater  than  three  meter  dry  gap 
width.  The  same  Golay  operation  applied  to  the  entire  watercourse 
delineation  serves  to  locate  points  where  the  stream  disappears.  Subtracting 
these  stream  end  points  from  the  three  meter  segment  end  point  leaves 
only  the  desired  transitional  points. 

4.  Encoding  Watercourse  Delineation 

After  categorization,  the  encoding  of  watercourses  by  line  dashing,  can 
and  should  be  done  by  automated  means.  All  the  dry  gap  width  symbols 
specified  in  the  Terrain  Analysis  Procedural  Guide  for  Drainage  and 
Water  Resources  can  be  generated  from  a  series  of  points  equally  spaced 
along  the  watercourse  center  line.  Figure  55  is  an  algorithm  (untested) 
which  could  be  used  to  generate  these  points  and  Figure  55  lists  methods 
by  which  the  dot  pattern  could  be  used  to  encode  lines  with  the  desired 
patterns.  Note  that  the  feature  encoding  procedures  are  all  raster 
(line  by  line)  algorithms  as  opposed  to  line  following  algorithms.  The 
raster  processing  approach  has  the  advantages  of  neither  being  affected 
by  Image  Size,  complexity,  nor  an  occasional  broken  or  non  contiguous 
watercourse. 
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GENERATE  CELL  PATTERN 
WITH  DESIRED  SPACING 


^xTlHILE^ 
"CELL  ROWS 
^  REMAIN 


D  ALL  BUT  TOP  SCAN 
LINE  OF  CELL  ROW  INTO 
WORKING  BUFFER 


^  WHILE  ^ 
CELLS  RENAII 


IF  ^ 
CELL  TOP 


OUTPUT  ONE 
TOP  PIXEL 


tELL  SIDE 
INTERSECTK 


OUTPUT  ONE 
SIDE  PIXEL 


EERO  CELL 
BOTTOM 


MOVE  CELL  BOTTOM  TO  TOP 
LINE  OF  WORKING  BUFFER 


Figure  55.  Raster  Operating  Line  Dotting  Algorithm 
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1 .  GENERATE  CLOSELY  SPACED  DOTS 

FROM  SINGLE  PIXEL  WIDTH 

WATER  COURSE  CENTER  LINE. 

2.  GROW  DOTS  INTO  SMALL  CIRCULAR 
AREAS  VIA  GOLAY  PROCESSING 
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3<W<10 

1.  GENERATE  WIDELY  SPACED  DOTS 

FROM  CENTER  LINE 

2.  GROW  DOTS  INTO  CIRCULAR  AREAS 

VIA  GOLAY  PROCESSING 

3.  OUTLINE  CIRCUUR  AREAS  VIA 

GOLAY  PROCESSING 

4.  SUBTRACT  OUTLINE  FROM  CENTER 

LINE 

•  •  • 

e  e  e 
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10<W<18 

1 .  GENERATE  MODERATELY  SPACED 

DOTS  FROM  CENTER  LINE 

2.  GROW  DOTS  TO  SMALL  CIRCULAR 

AREAS 

3.  SUBTRACT  AREAS  FROM  CENTER 

LINE 
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2.  GROW  DASHED  LINE  VIA 

GOLAY  PROCESSING 
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GROW  CENTER  LINE  VIA 
GOLAY  PROCESSING 


Figure  56.  Encoding  Watercourse  Delineation 
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V.  CONCLUSIONS 

Phase  1  and  Phase  2  of  the  study  have  concentrated  on  the  feasibility  and 
use  of  man-machine  interactive  digital  processing  techniques  for  the 
extraction  of  terrain  data  elements  from  aerial  imagery.  Interactive 
digital  techniques  Mere  developed  for  vegetation/1  and  cover  boundary 
extraction  and  for  extraction  of  forest-related  data  elements.  These 
techniques  included  the  use  of  spatial  crown  and  texture  operators. 

Applications  of  these  operators  during  Phase  1,  enabled  the  extraction 
of  feature  roughness  at  several  scales;  extraction  of  vegetction  types, 
wet  areas  and  water  bodies;  and  the  determination  of  forested  areas, 
forest  canopy  and  locations  of  individual  trees.  The  overall  success  of 
Phase  1  suggested  the  need  to  further  test  the  operators  relative  to 
water  resources  data  element  and  to  improve  and  test  the  spatial  crown 
and  texture  operators  at  different  scales. 

The  development  and  coding  of  software  included  programs  in  image  resolution 
and  scale  changing,  feature  skeletonizing,  and  theme  smoothing.  These 
programs  are  implemented  on  the  GE  DIAL  system,  primarily  in  Fortran 
language.  Limited  testing  of  the  programs  have  been  completed  in  Phase  2 
to  demonstrate  usefulness.  The  implementation  of  these  programs  on 
systems  similar  to  GE  DIAL,  is  feasible. 

Extraction  of  water  resources  data  elements  requires  outlining  features 
such  as  vegetation  boundaries  and  shore  line  delineation  of  water  bodies. 
Through  spatial  binary  processing,  or  Golay  processing,  features  were 
quickly  and  flawlessly  outlined. 

A  slight  variation  of  outlining,  line  stripping,  provided  a  feasible,  but 
somewhat  lengthy  (multiple  pass)  mean  of  categorizing  watercourses  by  the 
width  of  their  manually  mapped  dry  gaps.  Terminal  points  of  watercourse 
segments  can  also  be  located  by  one  pass  Golay  processing.  Efforts  to 
delineate  watercourses,  the  prime  water  resources  element,  were  only 
partially  successful.  The  seemingly  simple  problem  was  to  connect 
separated  pixels  of  a  watercourse  theme,  and  then  shrink  or  skeletonize 
the  feature  into  a  single  pixel  width  centerline.  Satisfactory  delineation 
was  achieved  for  certain  cases  but  no  universally  applicable  techniques 
were  found. 
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The  production  of  usable  factor  overlays »  which  are  the  desired  result 
of  terrain  element  extraction  was  addressed  and  handled  by  writing  what 
Is  thought  to  be  an  Important  theme  filtering  program.  Its  basic. purpose 
was  to  perform  spatial  low  pass  filtering  on  a  categorized  Image  as 
required  to  generate  overlays  which  resemble  those  made  by  photointerpretation 
anoi  which  are  spatially  simple  enough  to  be  combined  Into  complex  overlays. 
Provisions  are  made  to  restrict  change  of  critical  or  exceptionally 
accurate  themes  and  to  remap  on  a  spatial  basis  those  which  are  Incidental 
or  plagued  with  categorization  errors. 


VI.  RECOMMENDATIONS 

In  the  performance  of  Phase  2,  areas  were  Identified  as  candidates  for 
further  Investigation.  Generally,  these  candidates  Include  work 
described  as  testing  of  existing  software/techniques  and  development  of 
new  software/techniques.  The  recommended  areas  for  future  work  are: 

e  Continue  to  perform  sufficient  testing  of  techniques  developed 
In  both  Phase  1  and  Phase  2.  The  testing  should  Include  various 
sites  and  ground  data  to  radiate  the  techniques, 
t  Limited  results  were  obtained  for  delineation  of  line  features, 

I.e.,  streams  and  roads.  It  Is  believed  that  the  existing  Go1ay 
algorithm,  an  already  Invaluable  tool,  could  be  revised  and 
made  to  perform  error  free  skeletonizing, 
e  Further  testing  of  the  theme  filtering  program  Is  suggested.  This 
testing  Is  relative  to  the  production  of  factor  overlap,  I.e.  a 
comparison  of  manual  Interpretation  vs.  computer.  The  theme 
filtering  program  has  proven  valuable  as  a  cosmetic  noise  cleaner 
and  as  a  tool  In  the  feature  extraction  process.  It  allows 
satisfactory  results  to  be  filtered  from  otherwise  unacceptable 
themes.  Although  not  tested  In  this  respect.  It  Is  also  seen 
’  as  a  promising  means  of  digitalis  combining  selected  themes  into 
complex  overlays.  While  highly  effective,  the  program  Is  somewhat 
cumbersome  to  set  up,  and  the  operator  Interface  should  be 
rewritten  so  that  cotmonly  used  filtering  options  are  menu 
selectable.  With  the  minor  change  the  program  Is  recommended  for 
general  Interactive  use. 

e  To  date,  processing  of  Imagery  data  has  been  restricted  to  small 
geographical  areas.  The  testing  of  developed  techniques  from 
Phase  1  and  2  to  mosaicked  Images  Is  needed  relative  to  the  practical 
uses  of  terrain  analysis.  It  Is  recommended  that  such  work 
be  performed  to  allow  for  the  expansion  of  the  techniques  to 
largen  geographical  areas. 
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APPENDIX  A 


IMAGE  RESOLUTION  AND 
SCALE  CHANGING  PROGRAM 
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THEME  FILTERING  PROGRAM 
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